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Abstract 

We investigate the complexity of cut-reduction on proof notations, 
in particular identifying situations where cut-reduction operates feasibly, 
i.e., sub-exponential, on proof notations. We then apply the machinery 
to characterise definable search problem in Bounded Arithmetic. 

To explain our results with an example, let E(d) denote Mints' con- 
tinuous cut-reduction operator which reduces the complexity of all cuts 
of a propositional derivation d by one level. We will show that if all sub- 
proofs of d can be denoted with notations of size s, and the height of d 
is h, then sub-proofs of the derivation E(d) can be denoted by notations 
of size h ■ (s + 0(1)). Together with the observation that determining the 
last inference of a denoted derivation as well as determining notations for 
immediate sub-derivations is easy (i.e., polynomial time computable), we 
can apply this result to re-obtain that the E^-definable functions of the 
Bounded Arithmetic theory S2 are in the i-th level of the polynomial time 
hierarchy of functions FP 



1 Introduction and Related Work 



Since Gentzen's invention of the "Logik Kalkul" LK and the proof of his "Haupt- 
satz" Gcn35a, Gcn35bJ, cut-elimination has been studied in many papers on 
proof theory. Mints' invention of continuous normalisation |Min78[ IKMS75) 
isolates operational aspects of normalisation, that is the manipulations on (in- 
fmitary) propositional derivations. These operational aspects are described in- 
dependently of the system's proof theoretic complexity, but at the expense of 
introducing the void logical rule of repetition to balance derivation trees. 
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Note that this rule is both logically valid and preserves the sub-formula property, 
which in particular means that it does not harm computational tasks related to 
derivations as long as it does not occur too often. 

It is well-known that, using (TV), the cut-elimination operator becomes a 
primitive recursive function which is continuous w.r.t. the standard metric on 
infinitary trees: the normalisation procedure requires only as much informa- 
tion of the input as it produces output, using (1Z) as the last inference rule of 
the normal derivation, if the result cannot immediately be determined ( "please 
wait"). 

In fact, associating some of the repetition rules with computation steps 
bounds for the simply-typed lambda calculus can be obtained that bound the 
sum of the number of computation steps and the size of the output |AJ05j . 
strengthening earlier results by Beckmann [BecOl . Using Schutte's w-rule |Sch51] 
this method can also be applied to Godel's [God58] system T. 

In this report, we will re-examine this situation. We will show that the cut- 
reduction operator can be understood as a polynomial time operation natural 
way, see Observation ^. 12l We will work with proof notations which give implicit 
descriptions of (infinite) propositional proofs: a proof notation system will be a 
set which is equipped with some functions, most importantly two which compute 
the following tasks: 

• Given a notation h, compute the last inference tp(/i) in the denoted proof. 

• Given a notation h and a number i G N, compute a notation h[i] for the 
i-th immediate sub-derivation of the derivation denoted by h. 

Implicit proof notations given in this way uniquely determine a propositional 
derivation tree, by exploring the derivation tree from its root and determining 
the inference at each node of the tree. The cut-reduction operator will be 
defined on such implicitly described derivation trees. For this, we build on 
Buchholz' technical very smooth approach to notation systems for continuous 
cut-elimination [Buc91i !Buc97j . Our main result of the first part of the report in 
particular implies the following statement, as can be seen from Corollary 19. Ill 
Let 2„(x) denote the n-fold iteration of exponentiation 2 X . 

Let d be some propositional derivation, and assume that all sub- 
proofs of d can be denoted with notations of size bounded by s, 
and that the height of d is h. Then, all sub-proofs of the derivation 
obtained from d by reducing the complexity of cut-formulae by k 
can be denoted by notations of size bounded by 2fc_i(2/i) • s. 

Observe that the size of notations is exponential only in the height of the original 
derivation. In the second part of this report we will identify situations occurring 
in proof-theoretical investigations of Bounded Arithmetic where this height is 
bounded by an iterated logarithm of some global size parameter, making these 
sizes feasible. 
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Bounded Arithmetic has been introduced by Buss [Bus 8 6] as theories of 
arithmetic with a strong connection to computational complexity. For sake 
of simplicity of this introduction, we will concentrate only on the Bounded 
Arithmetic theories S l 2 by Buss [B us86j . These theories are given as first or- 
der theories of arithmetic in a language which suitably extends that of Peano 
Arithmetic where induction is restricted in two ways. First, logarithmic induc- 
tion is considered which only inducts over a logarithmic part of the universe of 
discourse. 

99(0) A (Vz)OO) -» <p(x+l)) -> (Vx)<p(|x|) . 

Here, \x\ denotes the length of the binary representation of the natural num- 
ber x, which defines a kind of logarithm on natural numbers. Second, the 
properties which can be inducted on, must be described by a suitably restricted 
("bounded") formula. The class of formulae used here are the E^-formulae 
which exactly characterise that is, properties of the z-th level of the poly- 
nomial time hierarchy of predicates. The theory's S l 2 main ingredients are the 
instances of logarithmic induction for Y!° formulae. 

Let a (multi-) function / be called Indefinable in S|, if its graph can be 
expressed by a E^-formula ip, such that the totality of /, which renders as 
(yx)(3y)ip(x, y), is provable from the S^-axioms in first-order logic. The main 
results characterising definable (multi-) functions in Bounded Arithmetic are 
the following. 

• Buss |Bus86j has characterised the £]?-definable functions of SJ> as FP 2 ^ 1 , 
the i-th level of the polynomial time hierarchy of functions. 

• Krajfcck [Kra93 has characterised the E^ +1 -dcfinablc multi-functions of 

yb 

S2 as the class FP i [wit, O (log n)] of multi-functions which can be com- 
puted in polynomial time using a witness oracle from E?, where the num- 
ber of oracle queries is restricted to O(logrt) many (n being the length of 
the input). 

• Buss and Krajicek |BK94j have characterised the Ek_ ^definable multi- 

yb 

functions of S| as projections of solutions to problems from PLS l - 2 , which 
is the class of polynomial local search problems relativised to Ef_ 2 -oracles. 

We will re-obtain all these definability characterisations by one unifying 
method using the results from the first part of this report in the following 
way. First, we will define a suitable notation system Hba for propositional 
derivations which are obtained by translating Bounded Arithmetic proofs. The 
propositional translation used here is well-known in proof-theoretic investiga- 
tions; the translation has been described by Tait |Tai68j . and later was inde- 
pendently discovered by Paris and Wilkie [PW85j . In the Bounded- Arithmetic 
world it is known as the Paris- Wilkie translation. 

Applying the machinery from the first part we obtain a notation system 
CHba of cut-elimination for Hba ■ CHba will have the property that its implicit 
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descriptions, most notably the functions tp(/i) and h[i] mentioned above, will 
be polynomial time computable. 

This allows us to formulate a general local search problem on CTIba which 
is suitable to characterise definable multi-functions for Bounded Arithmetic. 
Assume that (Vx)(3y)(p(x,y), describing the totality of some multi-function, is 
provable in some Bounded Arithmetic theory. Fix a particularly nice formal 
proof p of this. Given iVeNwe want to describe a procedure which finds some 
K such that f(N_,K_) holds. Invert the proof p of (Vx)(3y)(p(x,y) to a proof 
of (3y)(p(x,y) where x is fresh a variable, then substitute N for all occurrences 
of x. This yields a proof of (3y)if(N_,y). Adding an appropriate number of 
cut-reduction operators we obtain a proof with all cut-formulae of (at most) the 
same logical complexity as ip. It should be noted that a notation h(N) for this 
proof can be computed in time polynomial in N. 

The general local search problem which finds a witness for (3y)cp(N, y) can 
now be characterised as follows. Its instance is given by N. The set of solutions 
are those notations of a suitable size, which denote a derivation having the 
property that the derived sequent is equivalent to (3y)(p(N, y) V ipi V • • • V ipi 
where all ipi are "simple enough" and false. An initial solution is given by 
h(N). A neighbour to a solution h is a solution which denotes an immediate 
sub-derivation of the derivation denoted by h, if this exists, and h otherwise. The 
cost of a notation is the height of the denoted derivation. The search task is to 
find a notation in the set of solutions which is a fixpoint of the neighbourhood 
function. Obviously, a solution to the search task must exist. In fact, any 
solution of minimal cost has this property. Now consider any solution to the 
search problem. It must have the property, that none of the immediate sub- 
derivations is in the solution space. This can only happen if the last inference 
derives (3y)(f(N_,y) from a true statement ip(N_,K_) for some K G N. Thus K 
is a witness to (3y)ip(N, y), and we can output K as a solution to our original 
witnessing problem. 

Depending on the complexity of logarithmic induction present in the Bounded 
Arithmetic theory we started with, and the level of definability, we obtain lo- 
cal search problems defined by functions of some level of the polynomial time 
hierarchy, and different bounds to the cost function. For example, if we start 
with the E^-definable functions of S2, we obtain a local search problem defined 

by properties in FP 2 *- 1 , where the cost function is bounded by \N\ ol - 1 \ Thus, 
by following the canonical path through the search problem which starts at 
the initial value and iterates the neighbourhood function, we obtain a path of 
polynomial length, which describes a procedure in FP i ~ 1 to compute a witness. 

Other research related to our investigations is a paper by Buss }Bus04] which 
also makes use of the Paris- Wilkie translation to obtain witnessing results by 
giving uniform descriptions of translated proofs. However, Buss' approach does 
not explicitely involve cut-elimination. Dynamic ordinal analysis [Bec03 ( Bcc06 
characterises the heights of propositional proof trees obtained via the Paris- 
Wilkie translation and cut-reduction. Therefore, it is not surprising that the 
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bounds obtained by dynamic ordinal analysis coincide with the bounds on cost 
functions we are exploiting here. 

The potential of our approach to the characterisations of definable search 
problems via notation systems is that it may lead to characterisations of so 
far uncharacterised definable search problems, most notably the S^-definable 
search problems in S| for i > 3. 

2 Proof Systems 

Let S be a set. The set of all subsets of S will be denoted by ^i(S), the set of 
all finite subsets of S will be denoted by ^3fi n (iS). 

Definition 2.1 (sequent). Let T be a set (of formulae), ks a binary relation on 
T (identity between formulae), and rk: ^(T) x J- — » N a function (rank). A se- 
quent over T, ~, rk is a finite subset of T . We use T, A, . . . as syntactic variables 
to denote sequents. With wA we denote the set {A £ J 7 : (3B E A) A rj B}. 

We usually write A 1: .. .,A n for {A x , ...,A n } and A, T, A for {A} U L U A, 
etc. We always write C-ik(A) instead of rk(C, A). 

We repeat standard Buchholz notation for proof systems |Buc97j . 

Definition 2.2. A proof system 6 over T, ~,rk is given by 

• a set of formal expressions called inference symbols (syntactic variable X); 

• for each inference symbol X an ordinal |X| < to, a sequent A(X) and a 
family of sequents (A t (X)) t< |i|. 

Proof systems may have inference symbols of the form Cute for C G 
these are called "cut inference symbols" and their use will (in Definition [2T| be 
measured by the C-cut rank. 

Notation 2.3. By writing (X) ' ' ' — ' '-— < ^ we declare 1 as an infer- 
ence symbol with \T\ = I, A(T) = A, A L (I) = A t . If \T\ — n we write 

A Ax ... A„_a . ...A l ...(l< I) 

instead of ^ — . 

A A 

Definition 2.4 (Inductive definition of S-quasi derivations). If X is an inference 
symbol of 6, and (d t ) t< |i| is a sequence of S-quasi derivations, then d := 
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^(di)i<\i\ is an &-quasi derivation with 



r(d):=A(2)U (J (T(d t ) \«A t (2)) 



(endsequent of d) 



<,<|Z| 

last(rf) := X 

:= d t for t < |J| 
C-crk(d) := sup({C-rk(T)} U {C-crk(d t ): t < |J|}) 



(/asi inference of d) 
(sub-derivation) 
(cut-rank of d) 




hgt(d) := sup{hgt(d t ) + 1: t < |J|} 
sz(d) Bz(d t )) + 1 



(height of d) 
(size of d) 



3 The infinitary proof system 

Definition 3.1. Let C = {T, _L,/\, V} be the set of (symbols for) connectives 
for infinitary logic. Their arity is given by |T| = |_L| = and |/\| = \\J\ = u>. We 
define a negation of the connectives according to the de Morgan laws: ->(T) = _L, 



Definition 3.2. The set of all infinitary formulae Cqc together with their rank 
is inductively defined by the clause: if c 6 C and A L 6 Coc for t < |c| then 
c(A)f.<| c | e £ oc and C-rk(c(A) t <| c |) = sup t< | c | (C-rk(A L ) + 1). 

Notation 

We denote T() by T and _L() by _L. 

Definition 3.3. -i denotes the operation on £oo which computes negation ac- 
cording to the de Morgan rules, i.e. 



Definition 3.4. The set of all infinitary formulae of finite rank is denoted with 
Too. The identity between jr^-formulae is the "true" set-theoretic equality. 

Definition 3.5. The infinitary proof system ©oo is the proof system over T x 
which is given by the following set of inference symbols: 



-n(-L) = T, -n(A) = V. and^(V)=A- 



^(c(A) t< | c| ):=^(c)HA)) 



(Ax) — 



(t < w) 



for A = /\(A t ) l<u e T c 



A 



OO 



(Ya) 



A 



for A = y(A l ) l<u G 



foo and i < uj 
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(Cut c ) 



C 



-.C 



for (7ef ( 







oo 




Definition 3.6. The ©oo- derivations are the 6oo-quasi derivations. 

With a Soo-derivation d = I(d L ) b< m we can associate a function from N <! 
to Soo by letting d(Q) := last(d) and 



4 Notation system for infinitary formulae 

Definition 4.1. A notation system for (infinitary) formulae is a set T of "for- 
mulae", together with four functions tp: T — > {T, _L, /\, \/}, •[•] : T x N — > T, 
-i: T — > J 7 , and rk: ^P(^ r ) x — > N called "outermost connective", "sub- 
formula" , "negation" and "rank" , and a relation « C J x J called "inten- 



sional equality", such that tp(-.(/)) = ->(tp(/)), ->(/)[«] = -(fW), C-rk(f) = 
C-rk(-./), C-rk(/[n]) < C-rk(/) for n < | tp(/)|, and / « ff implies tp(/) = tp( 3 ), 
/[n] « ff [n], -(/) « -(g) and C-rk(/) - C-r%). 



It should be noted that if T is a notation system for formulae, then so is 
T I ~ in the obvious way; moreover, in T j « the intcnsional equality is true 
equality in the quotient. The reason why we nevertheless explicitly consider 
an (intcnsional) equality relation is that we are interested in the computational 
complexity of notation systems and therefore prefer to take notations as the 
strings that arise naturally, rather than working on the quotient. Note that 
the latter would require us to compute canonical representations anyway and 
so would just push the problem to a different place. 

It should also be noted that the intcnsional equality is truly intcnsional. 
Two formulae are only equal, if they are given to us as being equal. The obvi- 
ous extcnsional equality would be the largest bisimulation, that is, the largest 
relation T x T satisfying / ~ g — > tp(/) = tp(g) A f[n] ~ g[n] A C-rk(/) = 
C-rk(g) A -if ~ ~^g. However, as most extensional concepts, the largest bisimu- 
lation is undecidable in almost all interesting cases and therefore not suited for 
an investigation of effective notations. 

Definition 4.2. Let T = (J 7 , tp, •[•], rk, «) be a notation system for infinitary 
formulae. The interpretation [/]oo of f E T is inductively defined as 





Ax otherwise 




1- f~9 I/]oo = Iff] 

2. f » 9 =► [/loo = [.9] 
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5 Semiformal proof systems 

Let T = (J 7 , tp, • [•] , rk, w) be a notation system for infinitary formulae. 

Definition 5.1. The semiformal proof system 6jr over T is the proof system 
over T which is given by the following set of inference symbols: 



(Ax A ) 



A for A e T with tp(A) = T 



(A c ) C[n] ^ (n£W) for C G T with tp(C) = A 

(yM _^!L for C £ J with tp(C) = V and i G N 

c 

(Cut c ) C for C £ J with tp(C) G {T, A} 

(Rep) I 
Abbreviations 

For tp(C) G {±, VI let (Cut c ) ° = " C denote (Cut^c) ^ C - C . 

Definition 5.2. The &r -derivations are the S;F-quasi derivations. 

Later in our applications, we will be concerned only with derivations of 
finite height, for which we can formulate slightly sharper upper bounds on cut- 
reduction than in the general (infinite) case (2 a versus 3"). Thus, from now on 
we will restrict attention to derivations of finite height only. 

Definition 5.3. Let d m F denote that d is an S .^-derivation with T(d) C 
«F, C-crk(d) < to, and hgt(d) < a < ui . 

Definition 5.4. The interpretation [cijoc of a &j^-derivation d = T(d L ) L< \x\ is 
defined as 

Moo := P]oc(R]oo) t <|X| 

where [I]oo is defined by 

[Ax^Joo := Ax 

IAaIoo : = AjAjoo 

[Cutcjoo := Cutjc]^ 
[Rcpjoo := Rep 

Observation 5.5. Tddj^) C [r(d)]oo 

Proof. Induction on d. The "C" , instead of the expected "=" is due to the 
fact, that only formulae are removed from the conclusion that are intensionally 
equal; compare also Observation 14.31 □ 
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6 Cut elimination for semiformal systems 

Let T — (J-, tp, •[■], rk, ss) be a notation system for infinitary formulae, and ©jr 
the semiformal proof system over T . We define Mints' continuous cut-reduction 
operator |Min78 , KMS75J following the description given by Buchholz |Buc91j . 
The only modification is our explicit use of intensional equality. 

Theorem 6.1 (and Definition). Let C E T with tp(C) = f\, and k < uj be given. 
We define an operator l k c such that: d \-% >m T,C I&(d) rn T, C[k}. 

Proof by induction on the build-up of d: W.l.o.g. we may assume that T = r(d)\ 

Case 1. last(d) G {/\ D : D « C}. Then 

I k c (d) :=Rep(I*(d(fc))) 

is a derivation as required. 

Case 2. I := last(d) ^ {Au : -D « C}. Then 

I*(d) :=Z(^(d(i))) i<m 

is a derivation as required. □ 

Theorem 6.2 (and Definition). Let C € T with tp(C) 6 {T, /\} fee given. 
We define an operator Re such that: do T, C & di T, -iC 

& C-rk(C)<m M c (d ,di) h£+f r. 

Proof by induction on the build-up d: W.l.o.g. we may assume that T — (L(d )\ 
«{C}) U (r(dx) \ «{-C}). Let I = last(di). 

Case 1. A (2) n «{-C} = 0. Then A(J) C L and di(i) h* m L, -.£7, A 4 (J) with 

[3i < (3 for all i < By induction hypothesis we obtain M.c(do,di(i)) ^cVi 1 
r, A»(2) for i < Hence 

Rc(d ,dO :=T(R<7(db,di(i)))i<|x| 
is a derivation as required. 

Case 2. A (1) D «{-iC} ^ 0. Then tp(C) ^ T, because otherwise there is some 
£) G A (I) with tp(Z?) = JL, but this is not satisfied by any of the inference 
symbols of the semiformal system 6 jr. Hence tp(C) = /\. We obtain that 
I = \J k D for some k e N and D w -,C, and d x (0) h^ m L, -iC, ->(7[fc] with 
fa < (3. By induction hypothesis we obtain R c (d ,di(Q)) I\ -.(?[*]. The 

Inversion Theorem shows l%{d ) L, C[fc]. Now C-rk(C[fcj) < C-rk(C) < m, 
hence 

Kc7(d ,di) := Cut C[fe] (l^(d o ),M c (d O) d 1 (0))) 
is a derivation as required. □ 
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Theorem 6.3 (and Definition). We define an operator E such that: 

d\-i m+1 r => Efrfjh^'r. 

Proof by induction on the build-up of d: W.l.o.g. we may assume that T = T(d). 
Case 1. last(d) = Cut c . Then C-rk(C) < m and d{0) r-£° m+1 T, C and 
d(l) l~c° m +i "'C with a < a. By induction hypothesis we obtain E(d(0)) ^ 
r, C and E(d(l)) i-jf^- 1 r, -.C. 

Case 1.1. tp(C) £ {T, A}, then by the last Theorem K c (E(d(0)),E(d(l))) h^' 
r, and 

E(d) := Rep(R c (E(d(0)),E(d(l)))) 
is a derivation as required. 

Case 1.2. tp(C) £ {T, A}, then M^ c (E(d(l)), E(d(0))) r-^ 0_1 T. Continue 
as before. 

Case 2. 1 := last(d) ^ Cutc. Then 

E(d) :=Z(E(d(i))) i<m 
is as required. □ 

Remark 6.4. Immediately from the definition we note that the operators I, K, 
and E only inspects the last inference symbol of a derivation to obtain the last 
inference symbol of the transformed derivation. It should be noted that this 
continuity would not be possible without the repetition rule. 

7 Notations for derivations and cut-elimination 

Let T be a notation system for formulae, and &?r the semiformal proof system 
over T from Definition 15.11 

Definition 7.1. A notation system for &yr is a set Ti. of notations and functions 
tp: H -> Sy, •[•]: x N -► H, T: H -> ^(J 7 ), crk: <p(J") xH^N, and 
o, | - 1 : 7i — > N\{0} called denoted last inference, denoted sub- derivation, denoted 
end-sequent, denoted cut-rank, denoted height and size, such that C-crk(/i[n]) < 
C-crk(/i), tp(/i) = Cut c implies C-rk(C) < C-crk(/i), o(/i[n]) < o(h) for n < 
| tp(h)\, and the following local faithfulness property holds for h £ W: 

A(tp(ft)) u |J (r(ftW) \ «A t (t P (fc)))) c «r(/i) . 
t<i tp(/i) 

Proposition 7.2. 

r(h[j})c*(r(h)uA 3 (tp(h))) 
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Definition 7.3. Let H — (H,tp, -[-^o, -|) be a notation system for &r . The 
interpretation [/i] of h G H is inductively defined as the following Sjr-derivation: 

M :=tp(ft)([ft[n]]) n <| t p (/l) | 

Observation 7.4. For h eH we have 

last([/i]) = tp(/i) 

[fc]W = [M4] /brt<|tp(/i)| 

r(M) c «r(/o 

We now extend a notation system 7i for 6jf to notation system for cut- 
elimination on H, by adding notations for the operators I, M and E from the 
previous section. 

Definition 7.5. The notation system CH for cut- elimination on H is given by 
the set of terms CH which are inductively defined by 

• H C CH, 

• he CH, C e T with tp(C) = f\, k < u> => \%heCH, 

• h ,h 1 eCH, C e T with tp(C) e {T,A} => Rc^i e CH, 

• heCH => EheCH, 

where I, R, E are new symbols, and functions tp : CH — > &f, •[•] : CH xN^ CW, 
r: CH -» $p fi „(.F), crk: x C7Y — > N, o: — > N \ {0} and |-|: CH -> N 

defined by recursion on the build-up of h G CH: 

• \t h & H then all functions are inherited from "H. 

• h = \ k c h : Let T(h) := {C[fc]} U (r(/i ) \ «{C}), C-crk(/i) := C-crk(/i ), 
o(h) := o(/io), and |/i := |/i | + 1. 



Case 1. tp(fto) e {Az?: £> « C}. Then let tp(ft) := Rep, and h[0] := 
l^o [fc]. 

Case 2. Otherwise, let tp(/i) := tp(/io), and := l^/io[«]- 



• h=R c h h 1 : Let X := tp(fti). We define r(ft) := (r(/i )\«{C})U(r(hi)\ 
«{^C}), C-crk(ft) := max{C-crk(/i ), C-crk(Zii)}, o(/i) := o(h ) + o(/ii), 
and := |ft | + + 1. 

Case 1. A (J) n «{^C} = 0: Then let tp(ft) := 1, and h[i] := RcKh^i]. 

Case 2. Otherwise, tp(C) ^ T, because if not there would be some 
D e A(X) with tp(D) = _L, but this is not satisfied by any of the inference 
symbols of the semiformal system &jr. Hence tp(C) = [\. Thus J = \J k D 
for some k E N and D w -iC. Then let tp(/i) := Cut C [fe] and ft[0] := l^/io, 
ft[l] := R c /iofti[0]. 



11 



• ft = Eh : Let T(h) := T(h ), C-crk(ft) := C-crk(ft ) - 1, o(ft) := 2°( ft °) - 1, 
and ft| := \ho\ + 1. 

Case 1. tp(fto) = Cute-: Then let tp(ft) := Rep and 
let ft[0] := R c Eft [0]Eft [l] if tp(C) £ {T,A}, 
let ft[0] := R. c E/k)[l]E/io[0] if tp(C) £ {T,A}- 

Case 2. Otherwise, let tp(ft) := tp(fto), and ft[i] := Efto[i]. 

Proof. The just defined system is a notation system for &p in the sense of 
Definition 17. II To prove this we have to show that 

o(h[n]) < o(ft) for n<|tp(ft)| (1) 

and that the local faithfulness property for F holds. We start by proving (JTJ) by 
induction on the build-up of ft £ CTL. 

If h <EH then (I) is inherited from H. If ft = \ k c h then h[n] = \ k c h [n'] for 
some n' and (fTJ) is immediate by induction hypothesis. 

Now let us consider the case ft = Rcfto^i- If h[n] — Rchohi[n'} for some n' 
then {1} is immediate by induction hypothesis. The other case is that ft[0] — 
l^/io for some k. We compute 

o(h[0}) = o(\ k c h ) = o(fto) < o(h ) + o(/n) = o(ft) 

since o(fti) > 0. 

Finally, let us consider the case ft — EtiQ. If h[n] — Efto[n] then (fTJ) is 
immediate by induction hypothesis. Otherwise, we are in the case ft[0] — 
Rc(Eho[i])(Eho\j]) for some C,i,j. By induction hypothesis we obtain that 
o(fto[*]) — (^o) — 1 and o(fto[j]) < o(ho) — 1. Hence 

o(R c (Eft [*])(Eft [j])) - o(Eh \i]) + o(Eh \j}) = 2°^ - 1 + 2°('^1) _ i 
< 2 . 2 o(/ l0 )-i _ j = 2 o(h ) _ 1 = Q ^ 

We now turn to the local faithfulness property of T which we also prove by 
induction on the build-up of ft £ CTC. We abbreviate 

*(ft) := A(tp(ft))U |J (r(ftM)\«A t (tp(ft)))) , 
t <|t P (h)| 

then we have to show *(ft) C «r(ft). 

• If ft e H then the local faithfulness property is inherited from H. 

• If ft = I* fto, then r(ft) := {C[/c]} U (T(ft ) \ «{C}). 

Case 1. tp(fto) e {A D : « C*}. Then T(ft [A;]) C *(ft ) U «{C*[fc]} hence 
*(ft) =0ur(l^ft o [fe]) 

= {C[fc]}u(r(ft [fc])WC}) 

C{C[fc]}u(*(ft )\«{C}) 

c'{c[fc]}u(«r(ft )\«{c}) c «r(ft) 
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Case 2. Otherwise, we compute 

*{h) = A(tp(V)) u (J (r(i^oM)\«A t (t P (M)) 

K|tp(/i )| 

= A(tp(/*>)) U |J ([{C[k}} U (r(^ [ t ]) \ \ «A t (tp(fto))) 

l< tp(fl ) I 

C {C[fc]} U ( [A(tp(fto)) U |J (r(/» [i]) \ «A t (tp(/i )))] \ 

K|tp(h )| 

= {C[fc]}u(*(M W^}) 

, c{c[fc]}u(«r(/ l0 )\ ! «{C}) c «r(ft) 

• ft= Rc/io/ii: LetX:=tp(/ii). We have := (r(/i ) \ ~{C}) U (r(/n) \ 
«{-Cr». 

Case 1. A(J) n «{^C} = 0: We compute 

*(/*) = A(J) U (J (r(RcAoftiW) \ »A ( (I)) 

t <|j| 

= A(j)u |J ([r(/ 1 „)\«{c}ur(/ ll [ l ])\«K}]\«A l (i)) 

t<|j| 

cr(Ao)\»{C}u([A(i)u (J (r(/ ll M)\«A t (j))]\«{^c}) 



t<|X| 



r(V)\«{C} u *(fei)\«{-c f } 



i.h. 



c r(/i )\~{C} u wr(/n)\«{-.c} c ^r(fe) 

Case 2. Otherwise, we compute 

*(h)=T(\ k c h )\^{C[k}} U r(R c /io/ii[0])\«{-C[fc]} 

= ({C[fc]}u(r(^ )\«{c})\«{C[fc]} 
u (r(ho) \ «{C} u r(Mo]) \ «{-c>) \ «{-c[*]} 

cv(h )\~{C} u (r(Mo])W-c[*]})\ 
cr(/i )\«{C} u 

tr(ho)\«{C}U!sr(/i 1 )\«{nC} c «r(A) 



/i = E/i : Then r(/i) := r(/i ). 
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Case 1. tp(ho) = Cute: Assume tp(C) G {T,/\}, then 

*(h)=T(R c Eh Eh 1 ) 

= r(E/ lo [0])\«{C} U r(EA [l])\w{-"C} 

= r(/*,[o])WC} u r(Mi]) W-c} 
= *(h ) c' »r(ho) c «r(/i) 

The case that tp(C) ^ {T, /\} runs similar. 
Case 2. Otherwise, we compute 



= A(t P (M) U |J (r(E/io[t])\wA t (tp(fto)) 

t<|tp(fc )| 

= A(tp(fto)) U |J (r(AoW) \ «A t (tp(/i ))) 



K|tp(fc )| 

= *(fto) c' »r(fto) = t*T(h) 



Remark 7.6. For the computation of T, the cut-elimination operators \q, Rc 
and E behave like the following inference symbols: 

(l « W' (Rc) JL T^ L - < E » T ' 

Definition 7.7. Let C7i be the notation system for cut-elimination on 7i. The 
interpretation is extended inductively from 7i to by defining 



lRahoh 1 \=St c ([ho\M) 
P]=E(W). 

Proposition 7.8. For /i G C7i we Ziaue 

last([/i]) = tp(/i) 

MW = W /or.<|tp(/i)| 
C-crk([/i]) < C-crk(fc) 

Proof. By induction on the build-up of /i G CH. If h E H then the assertion 
is inherited from and Observation 17.41 The remaining cases follow from 
Theorems EH [6721 and IQ1 □ 



14 



8 An Abstract Notion of Notation 



We are now interested in studying the size needed by the notations for sub- 
derivations of derivations obtained by the cut-elimination operator. To avoid 
losing the simple idea in a blurb of notation, we abstract our problem to a simple 
term-rewriting system. 

Definition 8.1. An abstract system of proof notations is a set V of "deriva- 
tions", together with two functions |-|,o(-): V — > N\ {0}, called "size" and 
"height" , and a relation -tCPxD called "reduction to a sub-derivation" , such 
that d — > a" implies o(d') < o(d). 

Observation 8.2 (and Definition). Let T be a notation system for formu- 
lae and &f the semiformal proof system over T . A notation system 7i = 
{7i, tp, •[■], o, |-|) for 6jf gives rise to an abstract system of proof notations by 
letting V — H and defining d — ► d! iff there exists an n < \ tp(d)| with d! = d[n]. 

Definition 8.3. If T> is an abstract system of proof notations, then V, the 
"cut elimination closure", is the abstract notation system extending V that is 
inductively defined by 

d 6 v dev dev eev dev 



dev \dev Rdeev EdeV 

\\d\ = \d\ + l |Rde| = |d| + |e| + l |Ed| = |d| + l 
d -> d! in V d^d' e e' d d' 



d' Id -> Id' Rde -» Rde' Ed -► Ed' 

d d' d d" 



Rde ^ Id Ed — > R(Ed')(Ed") 

o(ld) = o(d) o(Rde) = o(d) + o(e) o(Ed) = 2°^ - 1 
where E, R, I are new symbols. 

Proof. We have to show that whenever d — > d' for d,d' E T> then o(d) > o(d'). 
We show this by Induction following the inductive definition of the — > relation 
in I?. If d — > d' holds in T> because it already holds in V then o(d) > o(d') is 
inherited from D. The cases Id — > Id', Rde — > Rde' and Ed — > Ed' are immediate 
by induction hypothesis. 

For the remaining cases we argue as follows. In case Rde — > Id we calculate 
o(Rde) = o(d) + o(e) > o(d) = o(ld), since o(e) > 0. 

In the case Ed — > R(Ed'){Ed") thanks to d — > d' and d — » d" we have 
o(d) > o(d') + 1 and o(d) > o(d") + 1. So, we calculate o(R(Ed')(Ed")) = 
o(Ed')+o(Ed") = 2°( d ')-l+2°(' i ")-l < 2 o(d ^+2 o(d '">-l < 2°^-l = o(Ed). □ 

Let J be a notation system for formulae, &jr the semiformal proof system 
over J 7 , Ha notation system for 6jf, CH the notation system for cut-elimination 
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on TL with denoted height o and size |-|, and let V be the abstract system of 
proof notations associated with TL according to Observation [872] 



Definition 8.4. The abstraction h of h £ CTL is obtained by dropping all sub- 
and superscripts. It can be defined by induction on the build-up of h G CTL: 

• h eTL =>■ h:= h, 

• h = \@ho => h := \ho, 

• h — Rch hi =>■ h:=Rhoh%, 

• h — EfiQ =>■ h := Eho. 

We denote the set of abstractions for h 6 CTL by CTL. 

Observation 8.5 (and Definition). The set of abstractions CTL for CTL is a 

subsystem of the cut- elimination closure TLofTLin the following sense: Let — > 
denote the reduction to sub- derivation relation of TL, and define a reduction to 
sub- derivation relation ^ of CTL in the obvious way by h ^ h' iff there exists 
an n < |tp(/i)| with h! — h[n]. Then CTL — TL and ^C^. 



9 Size Bounds 

We now prove a bound on the size of (abstract) notations for cut-elimination. 
By induction on the build up of T> we assign every element a measure that 
bounds the size of all derivations reachable from it via iterated use of the — >- 
relation. A small problem arises in the base case; if d — * dl in T> because this 
holds in T> we have no means of bounding \d'\ in terms of \d\. So we use the 
usual trick jASOO] when a global measure is needed and assign each element d of 
V not a natural number but a monotone function d(d) such that \d'\ < $(d)(s) 
for all d — >* d! whenever s € N is a global bound on the size of all elements in 
V. 

Definition 9.1. An abstract system T> of proof notations is called s-bounded 
(for s € N), if for all d £ V it is the case that \d\ < s. 

Definition 9.2. If T> is an abstract system of proof notations and d €V, then 
by T>d we denote the set T>d = {d' \ d d'} C V considered an abstract 
system of proof notation with the structure induced by V. Here — >* denotes 
the reflexive transitive closure of — ». 

Definition 9.3. For V an abstract system of proof notations and d € V we say 
that d is s-bounded if T>d is. 

Definition 9.4. By 6 we denote the set of all monotone functions from N to 
N. 
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Definition 9.5. For V an abstract system of proof notations we define, a "size 
function" $(d) € S for every d £ T> by induction on the inductive definition of 
V as follows. 

• For d E V we set i?(d)(s) = s. 

• 0(ld)(s) = tf(d)(s) + l 

• d(Rde)(s) = max{|d| + l+tf(e)(s) , i?(d)(s)+l} 

• 0(Ed)(s) = o(d)(i?(d)(s) +2) 

Proof. The monotonicity of the defined function $(d) is immediately seen from 
the definition and the induction hypothesis. □ 

Proposition 9.6. IfT> is s-bounded then for every d £ T> we have \d\ < d(d)(s). 

Proof. By induction on the inductive definition of T>. 

If d £ X> then i?(d)(s) = s > |d|, since 2? is s-bounded. We calculate 
■d{\d)(s) = tf(d)(s) + 1 > \d\ + 1 = jldj, where we used that 0(d) (s) > \d\ by 
induction hypothesis. Also, d(Rde)(s) > \d\ + l + d(e)(s) > l + |d| + |e| = Rdej, 
using the induction hypothesis for e. Finally, d(Ed)(s) — o(d)(d(d)(s) + 2) > 
d(d)(s) + 1 > \d\ + 1 = |Ed|, where for the first inequality we used that o(d) > 1, 
and for the second inequality we used the induction hypothesis. □ 

Theorem 9.7. IfV is s-bounded, deV and d -> d' , then d{d)(s) > d(d')(s). 

Proof. Induction on the inductive definition of the relation d — > d! in T>. 

lid^d' because it holds in V then d(d)(s) =s = d(d')(s). 

If Id -> Id' thanks to d -> d' then d(ld)(s) = d(d)(s) + 1 > tf(d')(s) + 1 = 
d(ld')(s), where the inequality is due to the induction hypothesis. 

If Ed — > R(Ed')(Ed") thanks to d — > d' and d — » d" we argue as follows 

tf(R(Ed')(Ed"))(s) 

= max{|Ed'|+l+d(Ed")(s) , 0(Ed')(s)+l} 

= max{|d'|+2+o(d")(d(d")(s)+2) , o(d')(d(d')(s) + 2)} 

< max{tf(d')(s)+2+o(d")(tf(d")(s)+2) , o(d')(tf(d')(s) + 2)} 

< max{tf(d)(s)+2+o(d'')(d(d)(s)+2) , o(d')(tf(d)(s) + 2)} 

< max{tf(d)(s)+2+(o(d) - l)(d(d)(s)+2) , (o(d) - l)(0(d)(s) + 2)} 
= d{d)(s)+2+(o(d) - l)(d(d)(s)+2) 

= o(d)(d(d)(s)+2) 
= ^(Ed)(s) 

where for the first inequality we used Proposition 19. 61 for the second the induc- 
tion hypothesis, for the third that, since d — > d! and d — > d", both o(d') and 
o(d") are bounded by o(d) — 1. 

If Ed Ed' thanks to d -> d' then d(Ed')(s) = o(d') (0(^)0*) + 2 ) < 
o(d)(tf(d')(s) + 2) < o(d)(0(d)(s) + 2) = d(Ed)(s). 
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If Rde — > Rde' thanks to e — > e', then 
0(Rde')(s) 

= max{|d|+l+i?(e')(s) , i?(d)(s)+l} 
< max{|d| + l+??(e)(s) , tf(d)(s) + l} 
= d{Rde) 

where for the inequality we used the induction hypothesis. 

If Rde -> Id then tf(Rde)(s) > i?(d)(s) + 1 = i?(ld)(s). □ 

Now we draw the desired consequences of our main theorem by putting 
things together. 

Lemma 9.8. If T> is s-bounded, and d £ T> then T>d is i?(d)(s) -bounded. 

Proof. We first show by induction on the inductive definition of the reflexive 
transitive closure that for every d! G V c i = {d! G T> \ d — >* d'} we have i9(d)(s) > 
i?(d')(«)- The case d = d' is trivial and if d d' -> d" then i?(d)(s) > tf(d')(s) 
by induction hypothesis and d(d')(s) > $(d")(s) by Theorem 19.71 

Now, by Proposition 19.61 we know that $(d')(s) > |d'| for d' G P. So, with 
the previous claim, for d' G T>d we get d(d)(s) > i?(d')(s) > |d'|, which is the 
claim. □ 

Corollary 9.9. If d £ V is s-bounded then Ed is o(d)(s + 2)-bounded and EEd 
is 2°( d ) • o(d) • (s + 4)-bounded. 

Proof. Let d G X> be s-bounded and ft. := o(d). First we observe that (Pd)d' = 
XV for any d' G (2?d). So we can assume without loss of generality that V is 
s, ft-bounded. 

Lemma [9?8l now gives us that Ed is z?(Ed)(s)-bounded and EEd is i?(EEd)(s)- 
bounded. We calculate i?(Ed) = o(d)(t?(d)(s) + 2) = o(d)(s + 2) < h(s + 2) and 
tf(EEd) = o(Ed)(0(Ed)(d) + 2) = o(Ed)(h(s + 2) + 2) < (2 h - l){h(s + 2) + 2) < 
2 h -h-(s + A). □ 

Even though the above Corollary covers all the case usually needed in prac- 
tise, it is interesting to consider the general case. Recall that iterated exponen- 
tiation 2 n (x) is defined inductively by setting 2o(x) = x and 2 n +i(x) = 2 2n ^ x \ 
An easy induction shows that the height o(E n d) of the n-times cut-reduced 
derivation d is bounded by 2„(d). 

Lemma 9.10. ■d(E n d)(s) < 2 n _i(2 • o(d)) • s for all n > 1, s > 2 and o(d) > 2. 

Proof. Induction on n. For the case n = 1 we compute ■d(Ed)(s) = o(d)(s + 2) < 
2o(d)s. 

For n = 2 we compute &(EEd)(s) = {2°^ - l)(o(d)(s + 2) + 2). For o(d) = 2 
and o(d) = 3 we directly compute that this is bounded by 2 2o ^ d ^s. For o(d) > 4 
we compute ${EEd){s) < 2°( d Ho(d)s < 2 2o ^s. 

Now assume that the claim holds for n > 2. We then compute ■d(EE n d)(s) = 
o{E n d)(V{E n d)(s) + 2) < 2„_ 1 (2°( rf ) - 1) • (2„_i(2 • o(d)) • s + 2) < 2 n _ 1 (2°( d ) - 
1) • 2 • 2„(o(d)) • s < 2„(o(d)) • 2„(o(d)) • s < 2„(2 • o(d)) • s □ 
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As an immediate Corollary we obtain 

Corollary 9.11. If d 6 V is s-bounded of height o(d) = h for s > 2 and h > 2, 

then E k {d) is 2fc-i(2 • h) ■ s-bounded for all k > 1. 

In Corollary 19.111 one should note that the tower of exponentiations has 
height only k — 1. Hence there is one exponentiation less than the height of the 
denoted proof. 

We conclude this section by remarking that the cut-elimination operator can 
be viewed as a polynomial time computable operation. Assume we modify the 
size function on V to i?fc by changing all -d to and defining for the last case 

• fc (E<O(*) = (fc+l)-(0(d)(*) + 2) 

Then we obtain as before for T> s-bounded, d 6 V and k £ N, that |d| < ^fe(d)(s), 
and d — > d' implies $fc+i(d)(s) > i)k(d)(s). Hence, for d 6 T>, V s-bounded, and 
Ed -^ k d\ we obtain \d'\ < ■d k (Ed)(s) < (k + 1) • (s + 2). From this we can 
conclude the following observation: Let f[i\, . . . ,ik] ■— f[i\] ■ ■ ■ [ik]- 

Observation 9.12. The cut-reduction operator for infinitary propositional logic 
is a polynomial time operation in the following sense. 

Let T and Ti. be some notation systems for infinitary formulae and the semi- 
formal system Assume that J- and Ti. are polynomial time computable, and 
that in addition also the functions 

T x N <w -> T 
A (h, ...,i k )>-> A[ii, ...,i k ] 

and 

U x N<" n 
h, (ii, . .. ,i fe ) i-> h[ii, ...,ik] 

are polynomial time computable. 
Then, CH and the function 

H x N <w -» CH 
h, (ii, . ..,4) h-> (E/i)[«i, ...,ik] 

are polynomial time computable. 

10 Bounded Arithmetic 

Our proof-theoretic investigations are very much independent of the exact choice 
of the language. Therefore, we will be very liberal and allow symbols for all 
ptime functions. 
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Definition 10.1 (Language of Bounded Arithmetic). The language Cba of 
Bounded Arithmetic contains as non-logical symbols {=, <} for the binary rela- 
tion "equality" and "less than or equal" , and a symbol for each ptime function. 
In particular, it includes a constant c a for a G N whose interpretation in the 
standard model N is = a, unary function symbols | • | and 2''' which have their 
standard interpretation given by (|c a |) N = n and (2l Ca l) N = 2™ where n is the 
length of the binary representation of a, and the binary function symbols min 
and # whose standard interpretation arc minimisation and (c a # Cf,) N = 2"' m 
where n and m are the lengths of the binary representations of a resp. b. We 
will often write n instead of c„, and for cq. 

Atomic formulae are of the form s = t or s < t where s and t are terms. 
Literals are expressions of the form A or ->A where A is an atomic formula. 
Formulas arc build up from literals by means of A , V , (Vx) , (3x) . The negation 
->C for a formula C is defined via de Morgan's laws. Negation extends to sets 
of formulae in the usual way by applying it to their members individually. 

Let C be a set of £BA-formulae (think of Sjf), and A an £eA-formula. We 
define the C-rank of A, denoted C-rk(j4), by induction on the build-up of A: 

• If A G C U -.C, let C-MA) := 0. 

• If A = B A C or A = B V C, let C-rk(A) := 1 + max{C-rk( J B), C-rk(C)}. 

• If A = (\/x)B or A = (3x)B, let C-rk(A) := 1 + C-rk(B). 

We will use the following standard abbreviations. 

Definition 10.2 (Abbreviations). The expression A — > B denotes the expres- 
sion -iA V B. The expression s < t denotes -ii < s. Bounded quantifiers are 
introduced as follows: (Va; < t)A denotes (Vx)A x (mm(x, t)), (3x < t)A denotes 
(3x)A x (mm(x,t)), (Vz < t)A denotes (Vx < t)(x <t A), (3x < t)A denotes 
(3a; < t)(x < t A A), where x may not occur in t. 

Definition 10.3 (Bounded Formulas). The set BFOR of bounded £BA-formulae 
is the set of ^BA-formulae consisting of literals and closed under A , V , (Va; < t) , 
(3x<t). 

We now define a restricted (also called "strict" ) delineation of bounded for- 
mulae. 

Definition 10.4. The set s£^ is the subset of bounded ^BA-formulae whose 
elements are of the form 

(3zi < h){Vx 2 < h) . . . (Qx d < t d )(Qx d+1 < \t d+1 \)A(x) 

with Q and Q being of the corresponding alternating quantifier shape, and A 
being quantifier free. 

Definition 10.5. As axioms we allow all disjunctions of literals, i.e., all dis- 
junctions A of literals such that A is true in N under any assignment. Let us 
denote this set of axioms by BASIC. 
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We will base the definition of Bounded Arithmetic theories on a somewhat 
stronger normal form of induction. Let | • \ m denote the m-fold iteration of the 
function symbol | • |. 

Definition 10.6. Let lnd(A,z,t) denote the expression 

4,(0) A (Vz<t)(A -> A z (sz)) -> A z (t) . 
The set $-L"TND consists of all expressions of the form 

Ind(A,z, 211*1™!) 
with A G z a variable and t an £eA-term. 

This restricted form of induction implies the usual form, because the follow- 
ing can be proven from BASIC alone. 

Ind(A(min(i, 2)), ,2,21*1) -» Ind(A(z), z, i) 



11 Notation system for Bounded Arithmetic for- 
mulae 

Let ^ba be the set of closed formulae in BFOR. We define the outermost 
connective function on ^ba by 



tp(A) 



T A true literal 

_L A false literal 

f\ A is of the form A A A x or (ix)B 

\j A is of the form A V A x or (3x)B 



and the sub-formula function on ^ba x N by 
A[n] : 



A A literal 

4nin(n,i) ^4 is of the form A A A\ or A V A\ 
B x {n) A is of the form (\/x)B or (3x)B . 



The rank and negation functions for the notation system are those defined for 
£ba- 

We didn't have much choice on how to render BFOR into a notation system 
for formulae. Nevertheless, the above definition already shows that we have to 
work with a non-trivial intcnsional equality. The reason is that, even though in 
the process of the propositional translation we can make sure that we only have 
closed formulae, this still is not enough; we do have other closed terms than just 
the canonical ones. 
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Consider, for example, an arithmetical derivation ending in 

B(f®) 
3x.B(x) 

where / is some function symbol. In the propositional translation we have to 
provide some witness i for the \J\ X B , x *. -inference. The "obvious" choice seems 
to take i = / N (0). But this would require a derivation of (3x.B(x))[f N (0)] = 
£?(/ N (0)). The translation of the sub-derivation, on the other hand, gives us a 
derivation of B(f(0)). So, in order to make this a correct inference in the propo- 
sitional translation, he have to consider B(f(0)) and B(f N (0)) as intcnsionally 
equal. Note that both formulae are extensionally equal. 

We will now define an intensional equality which provides the above de- 
scribed identification. For t a closed term its numerical value t N £ N is defined 
in the obvious way. Let — >^ denote the rewriting relation obtained from 

{(t,E_): t a closed term} . 

For example, 

(Vx)(x< Li(5-3)J)^n(Vz)(z<7) . 
Let Wfj denote the reflexive, symmetric and transitive closure of — 

Proposition 11.1. The just defined system consisting of Tba, tp, •[•], -i, rk 
and «n forms a notation system for formulae in the sense of Definition \4-l\ 

Remark 11.2. It is an open problem what the complexity of «pj is (assuming 
a usual feasible arithmetisation of syntax). However, if the depth of expressions 
is restricted, and the number of function symbols representing polynomial time 
functions is also restricted to a finite subset, then the relation is polynomial 
time decidable. I.e., let « N fc denote the restriction of ~n to expressions of depth 
< k in which at most the first k function symbols occur. Then, for each k, the 
relation «N fc is a polynomial time predicate. 

From now on, we will assume that J~ba implicitly contains such a constant 
k without explicitly mentioning it. All formulae and terms used in ^ba are 
thus assumed to obey the abovementioned restriction on occurrences of function 
symbols and depth. We will come back to this restriction at relevant places. 
The next observation already makes use of this assumption. 

Observation 11.3. All relations and functions in J-ba are polynomial time 
computable. 

Proof. Under the just fixed convention, the relation r% is actually «N fe for some 
k. □ 

Definition 11.4. Let BA°° denote the semiformal proof system over J~ba ac- 
cording to Definition 15.11 
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12 A notation system for BA°° 

Definition 12.1. The finitary proof system BA* is the proof system over 
BFOR, W[f which is given by the following set of inference symbols. 

(Ax A ) ifVAe BASIC 

(/W) 4^ (vU>) ^vir (fce{M}) 

lA(v * )Aj IVxjA [y( ^ A > l3x)A 

-nF,F v (sy) -^F,FJ sy) 
(WDf) ' vK ,„ (IND^ 1 ) , ' " , - - n,ieN 



(Cute) 



C -O 



According to Definition 1 2. 4[ a BA*-quasi derivation h is equipped with func- 
tions TQi) denoting the endsequent of h, hgt(h) denoting the height of h, and 
sz(h) denoting the size of h. 

In our finitary proof system Schiitte's w-rule |Sch51j is replaced by rules 
with Eigenvariable conditions. Of course, the precise name of the Eigenvariable 
does not matter, as long as it is an Eigenvariable. For this reason, we think 
of the inference symbols A(vz) J 4' IND^'*, and IND^i"' 1 in BA*-quasi derivations 
as binding the variable y in the respective sub-derivations. Fortunately, we 
don't have to make this intuition precise, as we will always substitute only 
closed (arithmetical) terms into BA*-derivations and therefore no renaming of 
bound variables will be necessary; hence we don't have to define what this 
renaming would mean. Note, however, that the details of Definition 112.21 of 
BA*-derivations and Definition 112.41 of substitution become obvious with this 
intuition on mind. 

Definition 12.2 (Inductive definition of x: d). For x a finite list of disjoint 
variables and d = Xdo . . . d n —i a BA*-quasi-derivation we inductively define the 
relation x : d that d is a BA*-derivation with free variables among x as follows. 

• If x,y: ho and 1 e {A(W)A> IND^'*, IND^™' 4 } for some A,F,t,n,i, and 
FV(r(27i )) C {x} then x: Xh . 

• Iff: h and FV((3x)A),FV(t) C {x} then x: \f\ 3x)A ho. 

• If x : ho, x: h\ and FV(C) C {x} then x: CvXchoh\. 

• If FV(A) C {x} then x: Ax A , 

• If x : ho, x: h\ and X = Aa aAi with FV(Ao A A±) C {x} then x: Xhoh\. 

• If x: ho and X = VaqvAi with FV(Aq V A\) C {x} then x: Xho- 
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A BA*-derivation is a BA*-quasi derivation h such that for some x it holds 
x: h. We call a BA*-derivation h closed, if 0: h. 

Proposition 12.3. If x* : h then FV(T(h)) C {x}. In particular FV(T(/i)) = 
for closed h. 

Proof. Trivial induction on the inductive definition of a?: h. □ 

Definition 12.4. For h a BA*-derivation, y a variable and t a closed term 
of Bounded Arithmetic we define the substitution h(t/y) inductively by set- 
ting (Xho ■ ■ ■ h n -\)(t/y) to be X(t/y)ho(y/t) . . . h n -i(t/y) if X is not of the form 
A(vx)yi' IND|;*, or IND y p n ' 1 with the same variable y, and Xho ■ ■ ■ hn-i other- 
wise. 

Substitution for inference symbols is defined by setting 
Ax A (*/j/) = Ax A(t/l/ ) 

Aa aai (*/y) = A VAoAA, (*/») = V 

A(Va:)yt(Vy) = f\\(\fx)A)(t/y) V(3a) A = V((3a;)A)(t/v) 



Z.'ll.'/ 



WD*/(t/y) = IND^f IND^' l (*/y) = ^(t/,) 

We now show the substitution property for B A* -derivations. The formu- 
lation of Lemma 112.51 might look a bit strange with "C" instead of the more 
familiar equality. The reason is, that a substitution may make formulae equal 
which are not equal without the substitution. 

Recalling however Definition 15. 3[ we note that derivations h in fact prove 
every superset of T(h). Of course, an easy consequence of Lemma Tl 2. 5 1 is that 
if T(h) C A then T(h(t/y)) C A(t/y). 

Lemma 12.5. Assume x: h and let y be a variable and t a closed term, then 
x\{y}: h(t/y) and moreover T(h(t/y)) C (T(h))(t/y). 

Proof. We argue by induction on the build-up of h. 

In the cases where no substitution occurs (as h = X . . . with X of the form 
A(W)A> INDjp , or IND^'™' 1 with the same variable y) both claims are trivial. 

Otherwise, by induction hypothesis, we know that the sub-derivations are 
BA*-derivations with the correct set of free variables; since substitution is also 
carried out in the inference symbols, the y in the variable conditions for Cute 
and V(3ie)a wm a ^ so disappear due to the substitution. The Eigenvariable con- 
dition z £ FV(T(h)) will follow once we have shown the second claim. 

For the second claim we compute by induction hypothesis 

T((h(t/y))(L)) = T((h(L))(t/y)) C T((h( L )))(t/y) 
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Hence 

T(h(t/y)) = A (last (/^/j/))) U |J (r((h(t/y))(i)) \ « N A t (last (/*(*/</)))) 

t<| last(»| 

c" A(last(/ l ))(i/y) U |J (V{{h){i)){t/y) \ « N A t (last(/i))(t/2/)) 

l<\ last(h) 

C (A(last(/ l )) U |J (r((/i)(t)) \ « N A t (last(fc)))) (t/ y ) 

t<|last(ft)| 

=nwiv) 

This finishes the proof. □ 

We will now define the ingredients for a notation system for BA°°, which 
forms the embedding of BA* into B A°° . 

Let Hba be the set of closed BA*-derivations. 

For each h € Hba we define the denoted last inference tp(/i) as follows: Let 
h = Xh . . . h n _i, 



Ax A if 1 = Axa, where A is the "least" true literal in A 

Aa aAi if X = /\ Ao A Ai 

Va vAi ^ ^ = Va V Ai 

A(Vn;)A lf % — A(Vx)A 

Rep if J = INDp* 

Rep ifT = IND£ n '° 



Cut f , (n+2<) ifX = INDr ,l+1 
Cut c if X = Cut c 

For each h € Hba and j e N we define the denoted sub-derivation h[j] as 
follows: Let h = J/i • • • h n -\- If j > \tp(h)\ let h[j] := Ax 0= o- Otherwise, 
assume j < \ tp(h)\ and define 



^min(j.l) 


if 1 = 


Aa A A x 








if 1 = 


Va V Ai 






hoii/y) 


if 1 = 


A(Va;)A 








if 1 = 


V(3a;)A 






mvf^ho 


if J = 


IND^'* 






ho(n/y) 


if 1 = 


IND^'"'° 






IND^^o 


if J = 




and j 


= 


mB y,n+2\i ho 


if J = 


mD y,n,i+i 


and j 


= 1 




if J = 


Cut c 
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The denoted end-sequent function on Hba is given by T computed according 
to Definition 12.41 The size function |-| on Hba is given by \h\ := sz(h). 

To define the denoted height function we need some analysis yielding an 
upper bound to the log of the lengths of inductions which may occur during 
the embedding (we take the log as this bounds the height of the derivation tree 
which embeds the application of induction). Let us first assume m is such an 
upper bound, and let us define the denoted height o m (h) of h relative to m: For 
a BA*-derivation h — Xho ■ ■ . /i n ~i we define 

(o m (h )+i+l ifZ = iND£"' 1 
o m (h) := I o m (h ) + m+ 1 ifT = IND^' 
[ 1 + sup i<n o m (hi) otherwise 

Observe that o m (h) > (in particular, o(Axa) = 1). 

To fill the gap of providing a suitable upper bound function of BA*-derivations 
we first need to fix monotone bounding terms for any term in Cba- 

Bounding terms 

For a term t we define a term bd(i) which represents a monotone function with 
the following property: If FV(t) = {x] then 

(Vn) t 3 (nf < bd(t) 3 (nf 

Let xq, x±, X2, ■ ■ ■ be a fixed list of free variables. We fix for each function symbol 
/ of arity n a monotone bounding term Tf with FV(Ty) C [xq, . . . , E.g., 
assume that we have fixed for each function symbol / in our language a number 
c f G N such that (Vr?)|/ N (n)| < max{2, \n\} 2 " f holds. We then can define 

T f := (max{2, x })#... # (max{2, x}) . 

2 c f times 

As the only exception we demand that Tj.i := |x |. 

Now, let t be a term. If t is a closed term, let bd(t) := t^. If t = ft\ . . . t n 
is not a closed term, let bd(i) :— (Tf)s(bd(ti), . . . ,bd(t n )). 

Bounding terms for BA*-derivations 

For h € Hba, the bounding term bd(h) is intended to bound any variable which 
occurs during the embedding of h, and the term | ibd(/i)| is intended to bound 
the length of any induction which occurs during the embedding of h. 
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Let h — XHq . . . h n —i be in H.BA-- We define 
'max(bd(ft (bd(t)/i/)),bd(t)) 



hd(h) 



ibd(h) := 



max(bd(/i ),bd(i)) 
max(bd(/ l0 (2L^^/y)),2l bd (*)l) 
max{bd(h ( n±Tj y)),n + 2 l ) 
max(bd(h ), . . . , bd(/i n -i)) 

'ibd(fto(bd(t)/i/)) 
max(ibd (fto (2L^W[/j/ ) ) , 2 1 bd « I ) 
max(ibd(/t ( n + 2V ?/)), 2*) 
v max(ibd(/i ), . . . , ibd(/i„_i)) 



V 



if j 
if j 

if z 

if j 

otherwise. 



(Vx<t)A 

t 

(3x)A 



if -2" — A(Vx<t)A 

if I: 



INDf;* 
ifZ = IND£™ 



otherwise. 

0|ibd(/i)|W for ^ e 



Now we can define the denoted height function o(h) 

Theorem 12.6. The just defined system consisting o/Hba, tp, ■[•], T 7 o(-) and 
| • | forms a notation system for BA°° in the sense of Definition\7. 1\ 



Proof. First, we observe that o(-) satisfies the following monotonicity property: 

m< vnl => o m (h) < o m >(h) . (2) 

We also observe the following substitution property by inspection: 

o m (h(t/y)) = o m {h) . (3) 

We prove the following slightly more general assertion: 

m>|ibd(/i)| & i<\tp(h)\ => o m (h[i]) < o m (h) (4) 

Then the assertion of the theorem follows using the monotonicity property @, 
as ibd(ft[i]) < ibd(ft). 

The proof of ([4]) is by induction on the build-up of h. Let h = Tho . . . h n -\. 

First assume that h[i] = hj(t/y). The definition of o m immediately shows 
that in this case o m (h) = 1 + sup i<n o m (/ij). The substitution property ^ 
shows that o m (hj(t/y)) — o m (hj). Hence 

o m (h) > o m (hj) = o m (hj(y/k)) = o m (h[i]) . 

The remaining cases are the following ones: 

Hh = IND v /h , then h[0] = INB y / M h . As \t\ < |bd(*)| < |ibd(/i)| < m 
we obtain 

o m (h[0]) = o m (h ) + \t\ + 1 < o m (h ) + m + 1 = o m (h) . 



Ifh = IND V F n ' k+1 h 0l then h[i] = IND 



y,n',k 



hn for some n' Hence 



o m (h[i\) = o m (h ) + k + 1 < o m (h ) + k + 2 = o m (h) 
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Thus, assertion (U|) is proven. The Theorem follows using the next Propo- 
sition which shows the local faithfulness property of the denoted end-sequent 
function T. □ 

Proposition 12.7. T satisfies the local faithfulness property: Let h S BA*, 
then 

A(t P (ft)) u |J (r(h[i]) \ « N A t (t P (/i)))J c « N r(/i) . 

L<\ tp(h)\ 

Proof by induction on o(h). Let h = I/io . . . h n -i G Hba- We abbreviate 

*(h) := A(tp(/i))U |J (r(ft[ 4 ])\w N A t (tp(A)))) . 
t<| tp(/»)| 

Case 1.1 = Axa: Let A be the "least" true literal in A, then 
*(h) = A(Ax A ) = {A} C A = T(h) 

Case 2. X = A c for C = A A An tp(h) = f\ c , h[0] = h and C[Q] = A , and 
h[i] = hi and C[l] = A\ for i > 0, hence 

= {A A Ai} U (T(h ) \ ~n{A }) U (T(fti) \ « N {A X }) 
= T(ft) 

Case 3. I = \J AoVAl 

Case 4. X = A(Wm : tp( ft ) = A(Vx)A> and fo M = /l oU/y) and ((Vx)A)[t] = 
A{l/x) for ieN hence 



*(/*) = {(Vx)A} U |J (T(ho(j/i,)) \ ^{A(i/x)}) 

iefi 

C {(Vx)A} U (JCWO/l/) \ «*{>*(*/*)}) 

j<EN 

^{(V X )A}u\J(T(h )\* N {A}) 

iGN 

= r(ft) 

(1): uses Eigenvariable condition. 

t t N 
Case 5.1 = V(3.e)a : tpC 1 ) = V(3x)A an d M°] = ^o, hence 



(h) = {(3x)A} u (r(M \ « N {A(t N /x)}) 

= {(3a;)^} U (T(Ao) \ « N {A(i/a:)}) 

= r(ft) 
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Case 6.1 = JND V /: tp(/i) = Rep and h[0] = IND^ ' 1 ' l h , hence 

*(^) = 0ur(iND^°' |tN| ^ o ) 

= {-^(0), F v ( + 2^ )} U (T(h ) \ « N {-.F, F y ( S y)}) 
C « N {-F y (0), F„(2l*l)} U (r(fto) \ « N {-F, F y (s j,)}) 
C w N r(/i) 

Case 7.1 = IND|;"' : tp(/i) = Rep and ft[0] = h (n/y), hence 
*(/*)= 0ur(/i o (n/y)) 

crW(n/») 

(2) 

C « N {-F y (n), F y (sn)} U (T(h ) \ « N {-F, F y (sy)}) 

C ~ N ({^(n),F y (n+l)} U (r(h ) \ « N {-F, ^(sy)})) 

= » N r(/i) 

(2) uses Eigenvariable condition. 

Case 8. J = IND» ,n,i+1 : tp(/i) = Cut F||(n+2<) , /i[0] = IND F ' n,< /i , and h[l] = 
lND V F n+2 * l h , hence (abbreviating 5 := r(ft ) \ ~ N {^F, F y (sy)}) 

*(h) = U (r(IND£ n '%) \ ^ w iFj n + 2' )}) 

U (r(IND^" +2, ^ ) \ ~N{-^(n±2!)}) 

= (({-F w (rO,F w (n±2!)}UH) \« N {F y (n + 2^}) 

U ((KFU n + 2' ), Fj n + 2 t+1 )} U S) \ -wl^ Un + 2*) >) 
C {^Fjn),Fj n + 2' +1 )}US 

Case 9. X = Cute: tp(/i) = Cute and h[i] = h L for t < 2, hence 
*(/*) = U (T(/i ) \ «n{C}) U (r(fti) \ « N {-C}) 

= r(ft) 

□ 

Observation 12.8. The following relations and functions are polynomial time 
computable: the finitary proof system BA* , the set of UK* -quasi derivations and 
the functions h T(h), h hgt(/i), and ft i— ► sz(/i) denoting the endsequent, 
the height and the size for a HA* -quasi derivation h; the bounding term t i— » 
bd(t) for terms t occurring in J-"ba and the relations bd(h) < m and ibd(ft) < m 
on Hba x N; the set Hba and the functions h tp(/i), h,i \— > ft[z], /i i— > r(/i), 
m,h i— > o m (h) and h^> \h\. 
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Proof. For bounding terms we use our assumption that a fixed (finite) num- 
ber of function symbols and term depth is only allowed, which implies that 
terms can only denote a fixed finite number of different polynomial time com- 
putable functions. That bd(h) < m is polynomial time computable is clear as 
the computation of bd(h) computes a monotone increasing sequence of values 
by successively applying one of the finitely many polynomial time computable 
functions, and once the bound to is exceeded during this process we can already 
output NO. □ 

As the function b&{h) in general may not be polynomially bounded, we 
cannot conclude in general that o{h) is polynomial time computable. However, 
the function to, h \— ► o min (i ibd(h)|,m)W i s polynomial time computable and will 
be sufficient in our applications. 



13 Computational content of proofs 

Let us start by describing the idea for computing witnesses using proof trees. 
Assume we have a BA proof of an existential formula (3y)ip(y) and we want to 
compute a k such that <f(k) is true - in case we are interested in definable func- 
tions, such a situation is obtained from a proof of (Vx)(3y)ip(x, y) by inverting 
the universal quantifier to some n G N. Assume further, we have applied some 
proof theoretical transformations to obtain a BA°° derivation d of (3y)ip(y) with 
C-crk(rf) < C-rk((p) for some set of formulae C (the choice of C depends on the 
level of definability we are interested in). Then we can define a path through d, 
represented by sub-derivations 

d = d , d\,d2, ■ ■ ■ 

with 

• de+\ = de(i) for some i G | last(c^)| 

• T(de) = (3y)ip(y),Te where all formulae A G Te are false and satisfy 
C-rk(A) < C-rk(p). 

As d is well-founded, such a path must be finite, i.e. ends with some dg say. 
In this situation we must have that last(e^) = \l k ^ y ^ v ^ and that cp(k) is true. 
Hence we can output k. 

Such a path can be viewed as the canonical path to the following local search 
problem: Let F be a set of possible solutions, which is a subset of BA°° contain- 
ing only those d! which satisfy that T(d') C {(3y)(p(y)} U F' where all formulae 
A G r' are false and satisfy C-rk(A) < C-rk((p). Furthermore, assume d G F and 
that F is closed under the following neighbourhood function N : BA°° — > BA°° 
which is defined by case distinction on the shape of last(d') for d' G F: 

• last(d) = Ax^4 cannot occur as all atomic formulae in T(d') are false. 
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• last(d) = Aa aAi ' then Ao A A\ must be false, hence some of Aq, A\ must 
be false. Let N(d) := d(0) if Ao is false, and d(l) otherwise. 

• last(d) = f\ A vA , then A V A\ must be false, hence both A , A\ must be 
false. Let N(d) := d(0). 

• last(d) = A(Vx)A(£c)- As (Vx)A(x) is false there is some i such that is 
false. Let N(d) := d{i). 

• last(d) = V(3x)A(xV If {3x)A(x) is different from (3y)ip(y) then (3x)A(x) 
must be false; let N(d) := d(0). Otherwise, let N(d) — d(0) in case ip(k) 
is false, and N(d) = d in case it is true (in which case we found a true 
solution to the original search problem). 

• last(d<?) = Cut c . If C is false let N(d) := d(0), otherwise let iV(d) := d(l). 

The idea in the following will be to use proof notations from Hba to denote 
this search problem. This way we will obtain characterisations of the definable 
functions of Bounded Arithmetic theories. 

The level of proof theoretic reduction will be adjusted in such a way that 
occurring formulae which have to be decided fall exactly in the computational 
class under consideration. So our main concern in order for this strategy to 
be meaningful is to find feasible upper bounds for the length of such reduction 
sequences and for the complexity of derivation notations occurring in them. 



13.1 Complexity notions for BA* 

In order to handle the complexity of BA* proof notations occurring in the set of 
possible solutions, we need some notions describing key complexity properties 
of them which we will provide first. 

Although tp(A) = A for any A starting with a V, and thus we can denote in- 
finitely many direct sub- formulae by A[n] for all n G N, only finitely many carry 
non-trivial information, because all quantifiers (and in particular this outermost 
V) are bounded. The next definition makes this formal by assigning first to each 
closed formula in Tba, then to each inference symbol in BA°°, and finally to 
each proof notation in CHba, its range. 

Definition 13.1. Let A be a formula in JT BA . We define the range of A, denoted 
rng(A), by 



if A a literal , 

2 if A = BAC or A = BVC , 

J N + 1 if A = (Vjc < t)B or A = (3x < t)B 



rng(A) := < 

Let X be an inference symbol of BA°° . We define the range of 1, denoted 
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rng(J), by 

(0 if J = Ax, 



rng(T) := 



1 if I = \J C or I = Rep 
rng(C) if J = A C . 

2 if J = Cut c • 



For h G CHba we define 

rng(ft) := rng(tp(/i)) . 

Definition 13.2. We extend the definition of bounding terms bd(h) and ibd(/i) 
from Hba to CHba in the following way by induction on the build-up of h G 
C7Yba: 

• If /i G Hba then the definition of bd(h) and ibd(/i) are inherited from the 
definition of bd resp. ibd(/i) on Hba- 

• If h = l^/io then 

hd{h) ;= fbd(fto) iffc<rng(C) , 
10 otherwise . 

ibd(ft) := ibd(/i ) 

• bd(Rc^o^i) := max{bd(/i ), bd(ft-i)}, ibd(Rc/io^i) : = max{ibd(/io), ibd(fti)}. 

• bd(E^o) := bd(fto), ibd(E/i ) := ibd(/i ). 
Lemma 13.3. Let h G CHba- 

1. If j < rng(/i) tfien bd(/i[j]) < bd(/i) and ibd(/i[j]) < ibd(ft). 

2. 7/tp(/i) = Vc then k ^ *>d(h). 

Proof by induction on the build-up of h. □ 

Definition 13.4. For h G BA* U CHba we define the set of decorations of h, 
deco(h) G *P/i„(BFOR) ; by induction on the build-up of h. Let h = Tho ■ ■ ■ h n -i- 
We define 

deco(ft-) := deco(J)( [J deco(/ij) J 



where 

deco(2)(5) := 



S U A(J) U {F} if J = IND^,'* orI= IND» ,0,i 
5UA(I) otherwise . 



Observation 13.5. We have T(h) C deco(/i). 

Definition 13.6. Let CompWsA be the set of all h G CHba which have the 
property that all occurrences of \q in h satisfy k < rng(C). 
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Definition 13.7. Let $ be a finite set of formulae in BFOR, and let K G N 
be a size parameter. With <&k we denote the set of formulae which result from 
formulae in <J> by substituting free variables by constants from {a : < i < K}. 

Lemma 13.8. Let h G Comp^BA and $ G <P/; n (BFOR) such that deco(h) C $, 
and $ is closed under negation and taking sub-formulae. Let j, if eN and y be 
a variable. 

1- If j <K and C G then C[j] G <S> K . 

2- If j < K then deco(/i(j/j/)) C $ K . 

3. A(tp(/i)) C deco(/i)bd(h) (subscript hd(h) needed e.g. for WD^ n,t+1 ) . 
4- If 3 < rng(/i) i/ien deco(%]) C $ bd(ft) . 

Proof. For 4., consider the case that h = Rch$hi, tp(/ii) = V^c an< ^ = 0> 1 - c - 
h[0] = \%h . By 3. we have ->C G $bd(/n), hence C G $bd(/i)- Also k < bd(/ii) 
by Lemma H3.31 2. Hence, C[fc] G $bd(7i) by 1. Now we compute 

deco(h[0]) = {C[k}} U decode) C $ bd(ft) U $ = $ bd(/l) . 

□ 

Lemma 13.9. For h G CHba we have that the cardinality of T(h) is bounded 
above by 2 • sz(h). 

Proof. Let the cardinality of a set S be denoted by card(S). We observe that 
card(A(Z)) < 2 for any X G BA°°. Thus we can compute for /i = I/io . . . /i n _i G 
CHba 

card(r(/i)) < card(A(I)) + ^ card(r(/i;)) < 2 + 2 • sz(^) = 2 • sz(/i) . 

□ 

13.2 Search problems defined by proof notations 

We identify the notation system Hba for BA°° with the abstract system of 
proof notations associated with it according to Observation 18.21 For s G N a 
size parameter we define 

H S BA := {h G Hba: \h\ < s} . 

Then H BA is an s-bounded, abstract system of proof notations, because we 
observe that h G Hba and h — > h' implies \h'\ < \h\. 

Remember that h for h G CHB^_denotes the abstraction of h which allows us 
to view CHba as a subsystem of Hba (see Definition 18.41 and Observation 18. 5|) . 

Definition 13.10. For h G CHba we define d(h)(s) := &(h){s). 
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Theorem 19.71 now reads as follows: 
Corollary 13.11. If h £ CH% k and h -> ti, then tf(h)(s) > $(ti)(s). 
Definition 13.12. We define a local search problem L parameterised by 

• a finite set of bounded formulae $ C BFOR, 

• a "complexity class " C given as a polynomial time computable set of £ba- 
formulae (usually C — E|? for some i), 

• a size parameter s £ N, 

• an initial value function h. : N — > Comp7ig A , where h a is presented in the 
form E . . . Eh(a/x) for some BA*-derivation h, 

• a formula (3y)cp(x,y) £ $ with -tip £ C, 
such that, for a £ N, 

. T{h a ) = {(3y)<p(a,y)}, 

• C-crk(h a ) < 1, 

. o(/i ) = 2l°l° (1 \ 

• !?(/»„)(«) = |o|°W, 

• deco (/i a ) C $ a , 
in the following way: 

• The set of possible solutions F(a) £ ^}3/; n (Comp7ig A ) is given as the set of 
those h £ Comp7ig A which satisfy: 

i) r(/i) C {(3y)<^(a, y)} U A for some A C C U such that all A £ A 
are closed and false, 

ii) C-crk(h) < 1, 
hi) o(h) < o(h a ), 

iv) 0{h)(a) < #(h a )(s), 

v) bd(/i) < bd(/i tt ) and ibd(/i) < ibd(/j a ), 

vi) deco(/i) C $bd(/i a ); 

• The initial value function is given by «(a) := h a ; 

• the cost function is defined as c(a,h) :— o(/i); and 
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• the neighbourhood function is given by 



'm 


if tp(/i) = 


A c , j < rng(C) and C\j] false 


h[0] 


if tp(h) = 


V c and C ^ (3y)ip(a,y) 




or tp(h) 


= y\av) v (a, y ) and Vfei) fa l se 


< h[0] 


if tp(h) = 


Cute an d C false , 


h[l] 


if tp(/i) = 


Cute and C true , 


h[0] 


if tp(/i) = 


Rep , 


h 


otherwise 





(Observe that the just defined neighbourhood function is a multi-function due 
to case Ac-) 

Proof. First observe that the initial value is indeed a possible solution, i(a) = 
h a € F(o). 

Let h E F(a), h! := N(a, h). Then we show 

1. h^h! implies h — > h' and o(h') < o(h), 

2. ti e F(a). 

For h = h! the assertions are obvious. So let us assume h ^ h' . Then /i' = 
for some j < mg(h) by construction. Hence, the first claim is obvious. 

For the second claim, we consider i)-vi) of the definition of h' G F(a): ii) 
is clear; iii) is obvious; for iv) observe that h — > h', thus $(h')(s) < 
by Corollary 113.111 for v) observe that j < rng(/i) implies bd(h') < bd(h) 
and ibd(h') < ibd(/i) by Lemma 113.31 for vi) observe that j < mg(h) im- 
plies deco(Zi') C ( < I ) bd(/i a ))bd(h) = < I ) bd(h a ) by Lemma [13.81 2., because bd(/i) < 
bd(/i a ). And finally for i) we first observe that the first condition that T(h) \ 
{(3y)ip(a, y)} is a subset of C U consisting only of closed formulae, is satis- 
fied, as C-cik(h) < 1. For the second condition of i) let X := tp(/i). We have by 
Proposition 17.21 that 

thus it is enough to show that \/Aj(X) is false. 

• I = Ac?: ^j'(^) = and C[j] false by construction. 

• X = V c : then i = °- If C ^ (3y)^(a,y), then A (X) = {C\i}}. Now C 
is false by i) of h € F(a), hence C[i] must be false as well. Otherwise, 
Aq(X) — {<fi(a,i)}, and <p(a,i) false by construction. 

• X = Cute: If j = 0, then A (X) — {C} and C false by construction. 
Otherwise, j = 1, then Ai(X) — {—>C} and -iC false by construction. 

• X = Rep: then j = and Ao(I) = and nothing is to show. 

□ 
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Proposition 13.13 (Complexity of L). F 6 P c , i,c <E FP, and N 6 FP c [wit, 1]. 



Proof. First observe that the functions a i— ► i(a) = h a , a i— > bd(/i a ), a 
ibd(/i a ), a i— > o(h a ), a i?(/i a ), and a i— > dcco(ft, a ) are polynomial time com- 
putable. 

Furthermore, the relations CompWg A , C-crk(/i) < 1, bd(h) < m, ibd(/i) < m 
and deco(/i) C <l> m are polynomial time computable, and once ibd(/i) < m is 
established we also can compute o(h) < m' and then o(h) in polynomial time. 
Hence c e FP 

Also, the functions tp(/i) and h[i] are polynomial time computable on CHba, 
which shows N G FP c [wit, 1]. 

For FeP c observe that C deco(/i) C $bd(/i a )j hence condition /i e 

F(a), i), is a property in P c . □ 

Proposition 13.14 (Properties of L). 1. N(a, h) = h implies tp(/i) = V(3 I /) ¥ >(a y) 
wii/i <p(a, i) tr«e. 77ms, £/ie Zoca/ search problem L defines a multi- function 
by mapping a to i (this is called the computed multi-function). 

2. The search problem L in general defines a search problem in PLS C , assum- 
ing that we turn the neighbourhood ( multi- ) function into a real function, 
which can easily be achieved by using an intermediate PL£> search prob- 
lem which looks for the smallest witness for the case tp(h) = /\ c . Then 

N e FP C . 

3. Assume o(h a ) — | a. | c>< - 1 ^ . Then the canonical path through L, which starts 
at h a and leads to a local minimum, is of polynomial length with terms of 
polynomial size, thus the computed multi- function is in FP e [wit, o(h a )}. 

□ 

13.3 ^-definable multi-funct ions in bn 

Let i > 2 and assume that S^T 1 b (Vx)(3y)(p(x,y) with (3y)tp(x,y) E E^, 
ip G n£_i- By partial cut-elimination we obtain some BA*-derivation h such 
that 

• FV(h) C {x}, 

. T(h) = {(3y)<p(x,y)}, 

• S^_ 1 -crk(/i) < 1, and 
. o(h(a/x))=0(\\a\\). 

We define a search problem by stating its parameters: 

• <!>:= deco(/i) is a finite set of formulae in BFOR, 

• as the "complexity class" we take C := 

• for the size parameter we choose s := \h\, 
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• the initial value function is given by h a :— h(a/x), 

• the formula is as given, (3y)ip(x,y). 

This defines a local search problem according to Definition 113.121 because 
. T(h a ) = T(h(a/x)) = T(h)(a/x) = {(3y)ip(a, y)}, 

• as h G Hft A we have h(a/x) G H| A , hence $(/i a )(s) = s = 0(1) 

• deco(/i a ) C $ a by Lemma [13.81 1. 

As o(/i a ) = 0(||a||), Proposition 113.141 3., shows that the computed multi- 

function of this search problem is in FP 4-1 [wit, (9(log n)] , which coincides with 
the description given by Kraji'cek Kra93j . 

13.4 E^-definable functions in S l 2 

Let i > and assume that S z 2 h (Vx)(3y)ip(x, y) with (3y)(p(x,y) £ £]?, ip G 
H^_i- By partial cut-elimination we obtain some BA*-derivation h such that 

• FV(/l) C {a;}, 

. T(h) = {(3y)cp(x,y)}, 

• E£_ r crk(/i) < 2, and 

• o(h(a/x)) = 0(\\a\\). 

We define a search problem by stating its parameters: 

• $ := deco(h) is a finite set of formulae in BFOR, 

• as the "complexity class" we take C := 

• for the size parameter we choose s := \h\, 

• the initial value function is given by h a :— Eh(a/x), 

• the formula is as given, (3y)ip(x,y). 

This defines a local search problem according to Definition 113. 12( because 

• r (M = {{3y)(p(a,y)}, 

• Sti-crk(/i a ) < 1, 

• o(h a ) = 2°(' i ^/*)) - 1 = 2°(ll a ID = |a|°«, 

• as h(a/x) G "H%^ we have 

d{h a ){s) =${Eh{a/x)){s) 

= o(h(a/x)) ■ (d(h(a/x))(s) + 2) 
= 0(||o||).( S + 2)=0(||o||) 
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• deco(h a ) C $ a . 

As o(h a ) = |a|°^ , Proposition 113.141 3., shows that the computed multi- 
function of this search problem is in FP 5 ^- 1 [wit, n ^] — FP 5 ^- 1 [wit]. 

But this immediately implies that the E^-definable functions of S2 are in 
FP E ;-% because a witness query to (3z < t)ip(u, z) can be replaced by \t\ many 
usual (non-witness) queries to x(a, b, u) = (3z < t)(a < z < b A ip{ u i z )) using a 
divide and conquer strategy. This characterisation coincides with the one given 
by Buss |Bus86j . 

13.5 S^-definable multi-functions in S^" 1 

Let i > and assume that S^T 1-1 h (\/x)(3y)ip(x,y) with (3y)ip(x,y) G 

(p G nj^i- By partial cut-elimination we obtain some BA*-derivation h such 

that 

• FV(h) C {x}, 

. r(h) = {{By)<p{x,y)}, 

• E^_ 1 -crk(/i) < 3, and 

• o(h(a/x))=0(\\a\\). 

We define a search problem by stating its parameters: 

• $ := deco(/i) is a finite set of formulae in BFOR, 

• as the "complexity class" we take C := IljjLi, 

• for the size parameter we choose s := \h\, 

• the initial value function is given by h a := EEh(a/x), 

• the formula is as given, (3y)ip(x,y). 

This defines a local search problem according to Definition 113.121 because 
. T(h a )={(3y)cp(a,y)}, 

• £ti-cxk(/i a ) < 1, 

• o(h a ) = 2°( E ' 1 ^/*)) - l = 2l a l° (1) , 

• as h(a/x) G Hg A we have 

■&(h a )(s) — ■d(EEh(a/x))(s) 

= o{Eh(a/x)) ■ (tf(Eh(a/x))(s) + 2) 
= ' (0(||o||) + 2) = |a|° (1) 

• deco(ha) C $ a . 

By Proposition 113.141 2., this defines a search problem in PLS 2 ^ 1 . This 
coincides with the description given by Buss and Krajfcek [BK94] . 
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13.6 £^ +1 -definable multi-functions in S^ +r L 2+J IND 

Let i > 1, j > 0, and assume that £j? +J .-L 2+ ^IND h (Vx)(3y)(p(x,y) with 
(3y)ip(x,y) G ip e LT^. By partial cut-elimination we obtain some BA*- 

derivation h such that 

• FV(/i) C {a;}, 

• r(/i)={(3j/Ma ; ,y)}, 

• E^-crk(/i) < j + 1, and 

• o(h(a/x)) = 0(\a\ 3+j ). 

We define a search problem by stating its parameters: 

• $ := deco(/i) is a finite set of formulae in BFOR, 

• as the "complexity class" we take C := Y^, 

• for the size parameter we choose s := \h\, 

• the initial value function is given by h a := E „ . Eh(a/x), 

j times 

• the formula is as given, (3y)ip(x, y). 

This defines a local search problem according to Definition 113. 12\ because 
. T(h a ) = {(3yMa,y)}, 

• E*-crk(/i ) < L 

• o{h a ) < 2 j (o(h(a/x))) = 2 J (0(\a\ 3+J )), 

• as h{a/x) 6 H^ A we have 

#(h a )(s)=ti(E^ : Eh(a/x))(s) 

= o(E_^_E/i(a/x)) • (^((E^E h(a/x))(s) + 2) 

(j-i)x (j-i)x 
= 2 j _ 1 (0(\a\ 3+j )) ■ (#((E_^E h(a/x))(s) + 2) 

= ••• = £%!) 

• deco(/i a ) C <£> a by Lemma T13.81 1. 

As o{h a ) = 0(\\a\\), Proposition 113.141 3., shows that the computed multi- 
function of this search problem is in F P S - [wi t, 2 i (C(log 2+i n))], which coincides 
with the description given by Pollett |Pol99j ■ 
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